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IMAGE PROCESSING CIRCUIT AND METHOD FOR PROCESSING IMAGE 

RELATED APPLICATION DATA 

The present application claims priority to Japanese 
5 Application No. P2000-087053 filed March 23, 2000, which 
application is incorporated herein by reference to the 
extent permitted by law. 

BACKGROUND OF THE INVENTION 

10 The present invention relates to an image processing 

circuit and a method for processing an image, and is 
applicable to, for example, the processing and the 
recording of the results of imaging with a video camera, 
an electronic still camera and the like, image displaying 

15 on a liquid crystal display and the like, image processing 
and image synthesis with a personal computer and the like, 
and image transmission by means of those apparatus. 

In conventional various image processing circuits 
such as an imaging apparatus, various kinds of processing 

2 0 such as recording and reproducing are performed after the 

dynamic range of an image is compressed. 

As for such processing of compressing the dynamic 
range, there are a method in which the gradation (gray 
scale) of the whole image is corrected and a method in 
25 which the gradation of only the low frequency components 
of an image is corrected. In the former method, the 
dynamic range is compressed by a correction of the 
gradation such as a gamma correction, a knee correction 
and so-called histogram equalization. On the other hand, 

3 0 in the latter method, the dynamic range is compressed by a 

correction of the gradation such as the gamma correction 
and the knee correction. 
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However, there is a problem that these dynamic 
range compressing methods are not practically sufficient, 

5 That is , by the method in which the gradation of 

the whole image is corrected by the gamma correction, the 
knee correction and the like, the contrast of an object 
as well as the dynamic range is compressed in a 
brightness region to be compressed, such as a brightness 

10 region including few highlight parts and histograms. 

Accordingly, the method has a problem that it is 
'ff difficult to increase the compression rate of the dynamic 

On range and a problem that an image having a low contrast 

and few variations is generated owing to the compression 
15 of the dynamic range. 

K 

E - 5 

ni On the other hand, in the method in which the 

-Jf gradation of only the low frequency components is 

k- corrected by the gamma correction, the knee correction 

20 and the like, a ratio of the low frequency components to 
the high frequency components of an image changes owing 
to the compression of the dynamic range. Owing to this 
change, the method has a problem that the edges of an 
image are unnaturally emphasized by the compression of 
25 the dynamic range and an image with degraded quality is 
generated. 

SUMMARY OF THE INVENTION 

The present invention was made in consideration of 
30 the aforesaid problems, and provides an image processing 
circuit or a method for processing an image, that may be 
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used for various types of apparatus handling image data 
such as an imaging apparatus, an image display apparatus, 
an image data transmission apparatus. 

5 The image processing circuit and method of the 

present invention are capable of compressing the dynamic 
range of an image while avoiding lowering of an 
impression concerning the contrast and unnatural edge 
emphasis of the image so as to compress the dynamic range 
10 of the image at a higher compression rate. 

ft* For solving such problems, according to a first 

*Zl aspect of the present invention, there is provided an 

p image processing circuit or a method for processing an 

Hi 15 image, in which a pixel value of an input image is 
;L a smoothed while preserving an edge of the input image and 

yj a gain correction coefficient is generated according to 

an output value of the smoothing processing to correct 
M the pixel value of the input image. 

20 

According to the configuration of the first aspect, 
when the pixel value of the input image is smoothed while 
preserving the edge of the input image, only the 
component determining the dynamic range of the input 

25 image can be extracted from the input image separately. 
Accordingly, when the gain correction coefficient is 
generated according to the output value of the smoothing 
processing to correct the pixel value of the input image, 
the lowering of the contrast of an object that is 

30 independent of the dynamic range of the image and is 
desired to be preserved without compressing it is 
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effectively evaded, and the dynamic range can be 
compressed at a desired compression rate. Moreover, 
because the lowering of the contrast of the object can 
effectively evaded, the unnatural edge emphasis can also 
5 be prevented, and thereby the dynamic range of an input 
image can be compressed at a high compression rate while 
quality of the input image is maintained. 



As described above, according to the present 
10 invention, a pixel value of an input image is smoothed 
while<preserving an edge of the input image to obtain a 
gain correction coefficient, and the pixel value of the 
input image is corrected on the basis of the gain 
correction coefficient. Consequently, the lowering of an 
15 impression concerning the contrast and the unnatural edge 
emphasis of the image are effectively evaded, and it 
becomes possible to compress the dynamic range of the 
image at a higher compression rate. 



20 BRIEF DESCRIPTION OF THE DRAWINGS 

The above and other objects, features and advantages 
of the present invention will become more apparent from 
the following description of the presently preferred 
exemplary embodiments of the invention taken in 
25 conjunction with the accompanying drawings, in which: 
Fig. 1 is an illustration showing equations 1; 
Fig. 2 is an illustration showing equations 2; 
Fig. 3 is an illustration showing equations 3; 
Fig. 4 is a block diagram showing an image 
30 processing circuit according to a first embodiment of the 
present invention; 
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Figs. 5A-5D are timing charts for illustrating the 
operation of the image processing circuit shown in Fig. 
4; 

Fig. 6 is a characteristic curve diagram showing a 
5 characteristic of the lookup table 3 of the image 
processing circuit shown in Fig. 4; 

Fig. 7 is a characteristic curve diagram showing a 
characteristic of the lookup table 6 of the image 
processing circuit shown in Fig. 4; 
10 Fig. 8 is a block diagram showing the non- linear 

^ smoothing unit of the image processing circuit shown in 

05 Fig. 4; 

m Figs. 9A and 9B are timing charts for illustrating 

*zi the operation of the non- linear smoothing unit shown in 

UJ. 15 Fig. 8; 

H Fig. 10 is a timing chart for illustrating the 

rt operation of the improved 8 filter of the non- linear 

yj smoothing unit shown in Fig. 8; 

Fig. 11 is a block diagram showing the improved e 
20 filter of the non- linear smoothing unit shown in Fig. 8; 
Fig. 12 is a block diagram showing the delay 
circuit of the improved 8 filter shown in Fig. 11; 

Fig. 13 is a block diagram showing the arithmetic 
operation circuit of the improved e filter shown in Fig. 
25 11; 

Fig. 14 is a characteristic curve diagram for 
illustrating a characteristic of the lookup table 3 of 
the image processing circuit shown in Fig. 4; 

Fig. 15 is a block diagram showing an image 
30 processing circuit according to a second embodiment of 
the present invention; 
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Figs. 16A-16F are time charts for illustrating the 
operation of the image processing circuit shown in Fig. 
15; 

Fig. 17 is a block diagram showing an image 
5 processing circuit according to a third embodiment of the 
present invention ; 

Fig. 18 is a characteristic curve diagram for 
illustrating a characteristic of the lookup table 52 of 
the image processing circuit shown in Fig. 15; 
10 Fig. 19 is a block diagram showing an image 

processing circuit according to a fourth embodiment of 
the present invention; 

Figs. 20A-20C are timing charts for illustrating 
the operation of the image processing circuit shown in 
15 Fig. 19; and 

Fig. 21 is a block diagram showing an image 
processing circuit according to a fifth embodiment of the 
present invention . 

20 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, the embodiments of the present 
invention will be described in detail by suitable 
reference to the attached drawings. 

25 (1) CONFIGURATION OF FIRST EMBODIMENT 

(1-1) WHOLE CONFIGURATION OF FIRST EMBODIMENT 
Fig. 4 is a block diagram showing an image 
processing circuit according to the first embodiment of 
the present invention. The present image processing 
30 circuit 1 is applied to an imaging apparatus such as a 
video camera and a digital camera, various image 
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processing apparatus, image transmission apparatus, the 
image processing in a personal computer, and the like for 
compressing the dynamic range of an input image X to 
output an output image Y. 

5 

Incidentally, here, the input image X and the 
output image Y are two-dimensional digital images. 
Hereinafter, positions of a pixel in the horizontal 
direction and the vertical direction are designated by 
10 marks 

O the input image X and the output image Y are designated 

03 by x(i, j ) and y(i, j ) , respectively. Moreover, 

Ul respective processed values corresponding to the pixel 

O values x(i, j ) and y(i, j ) are similarly designated marks 

Ci 15 1 

pi 

Mi In the image processing circuit 1, a non-linear 

hi smoothing unit 2 smoothes the pixel value x(i, j ) of the 

r: input image X to be input into the non- linear smoothing 

20 unit 2 with a large dynamic range as shown in Fig. 5A, 

and outputs a smoothed , image S based on a pixel value s(i, 
j) (shown in Fig. 5B) . In the smoothing processing, the 
non-linear smoothing unit 2 performs the smoothing 
processing by judging whether each pixel value x(i, j) is 
25 at an edge or not on the basis of the pixel value 

information and spatial information of the input image X, 
and thereby the non- linear smoothing unit 2 performs only 
the smoothing processing of components having small 
amplitudes and does not perform the smoothing processing 
30 of edge components which may have large amplitudes. 

Consequently, the non-linear smoothing unit 2 smoothes 
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the pixel value x(i, j) of the input image X while 
preserving the edge to take out only the component 
determining the dynamic range of the image X separately. 

5 A look-up table (LUT) 3 outputs a gain correction 

coefficient g(i, j) (shown in Fig. 5C) for correcting the 
pixel value x(i, j) of the input image X on the basis of 
the pixel value s(i, j) of the smoothed image S output 
from the non-linear smoothing unit 2. The image 
10 processing circuit 1 corrects the pixel value x(i, j) of 

p 

,y% the input image X with the gain correction coefficient 

p; 3 g(i, 3) to compress the dynamic range. The look-up table 

01 3 outputs the gain correction coefficient g(i, j) in 

j~ conformity of the input-output characteristic thereof 

15 having, for example, a monotonically decreasing 
□ characteristic shown in Fig. 6. Incidentally, in the 

m input-output characteristic shown in Fig. 6, when the 

^: pixel value s ( i , j ) of the smoothed image S is smaller 

H than a prescribed value si, the look-up table 3 outputs a 

20 gain correction coefficient g(i, j) of value 1.0. As the 
pixel value s(i, j) of the smoothed image S increases 
from the prescribed value si, the gain correction 
coefficient g(i, j) decreases exponentially to be a value 
gl at the max value s max of the pixel value s(i, j ) . 

25 

In accordance with such input -output characteristic, 
when the pixel value x(i, j) of the input image X rises 
before and after an edge with small variations of the 
pixel value, for example, as shown in Fig. 5A, the pixel 
30 value s(i, j ) of the smoothed image S in which the small 
variations of the pixel value are eliminated is obtained. 
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Then, the look-up table 3 outputs the gain correction 
coefficient g(i, 3) (shown in Fig. 5C) that takes a 
smaller value when the pixel value s(i, 3) takes a larger 
value. In this case, because the edge is preserved in 
5 the pixel value s(i, 3) of the smoothed image S, the 

look-up table 3 outputs the gain correction coefficient 
g(i, j), the value of which rapidly varies at the edge 
part . 

10 A delay circuit 4 delays image data constituting 

the input image X for an amount of time necessary for 
processing of the image data at the non- linear smoothing 
unit 2 and the look-up table 3. Thereby, the delay 
circuit 4 outputs the pixel value x(i, j) of the input 

15 image X at the adjusted timing with respect to the gain 
correction coefficient g(i, 3) which is outputted from 
the look-up table 3. 

A multiplier 5 multiplies the pixel value x(i, 3) 
20 of the input image X output from the delay circuit 4 by 

the gain correction coefficient g(i*j) for correcting the 
pixel value x(i, 3) of the input image X by the gain 
correction coefficient g(i, 3) to output a pixel value 
z(i, 3) for an image Z. 

25 

Now, because in the present embodiment the gain 
correction coefficient g(i, 3) is set to be equal to a 
value one or less, the multiplier 5 outputs the image Z 
having the pixel value z(i, 3) that has the compressed 
30 dynamic range of that of the input image X as shown in 
Fig. 5D. Furthermore, because the gain correction 
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coefficient g(i, j) having a value rapidly varying at the 
edge part owing to the smoothed image S # in which small 
variations are removed while the edge is preserved, is 
generated, the multiplier 5 generates the image Z, having 
5 the pixel value z(i, j), in which small variations of the 
pixel value of the input image X are preserved at the 
parts other than the edge part and only the variation of 
the pixel value at the edge part is compressed. That is, 
there is generated the image Z only the general dynamic 
10 range of which is selectively compressed, 

M 

m Thereby, the present embodiment outputs the image Z 

the dynamic range of which is compressed at a high 
compression rate while evading effectively the lowering 

bj 15 of an impression of the contrast owing to the compression 
of the small variations of pixel values and the unnatural 
edge emphasis owing to the variation of the frequency 

jj characteristic of an image. 



20 A look-up table 6 finally sets characteristics of 

the image Z the dynamic range of which is compressed, and 
generates the output image Y. That is, an input -output 
characteristic of the look-up table 6 is set so as to 
compress gradations near to black and to white as shown 

25 in Fig. 7. Thereby, the look-up table 6 prevents 

saturation of gradation at a part of the dynamic range of 
the image data output from the multiplier 5 that exceeds 
the dynamic range of the output image Y, and can 
effectively evade a situation that gradations of the 

30 output image Y near to black and to white are lost. 
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(1-2) NON-LINEAR SMOOTHING UNIT 

Fig. 8 is a block diagram showing a configuration 
of a non-linear smoothing unit 2. In the non-linear 
smoothing unit 2, a two-dimensional linear lowpass filter 
5 (LPF) is used as the lowpass filter 11 for smoothing the 
input image X. The generation of noise in a shape of a 
point at the following processing is prevented by the 
smoothing processing of the pixel value x(i, 3) of the 
input image X in advance to some extent. Incidentally, 
10 by the use of one-dimensional linear lowpass filers in 
the horizontal direction and the vertical direction of 
the input image X severally as the lowpass filter 11, the 
similar processing can be performed. 

15 A look-up table 12 performs a logarithmic 

transformation of the pixel value of image data Fl output 
from the lowpass filter 11 so as to output the 
logarithmically transformed data, and thereby the 
logarithmically transformed pixel value is smoothed in 

20 the following processing lest the degree of the smoothing 
differs with the pixel value. 

An improved e filter 13AX is a filter that has been 
changed a part of a non- linear smoothing filter called as 
25 an e filter. The improved e filter 13AX smoothes pixel 
values of the input image LI input by the look-up table 
12 while preserving edges in the horizontal direction of 
the image LI to output the smoothed pixel value. 

30 A successive improved e filter 13BX is a non-linear 

smoothing filter like the improved 6 filter 13AX, and 
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smoothes the pixel value of the input image L2 input by 
the improved e filter 13AX while preserving edges in the 
horizontal direction of the image L2 to output the 
smoothed pixel value. The improved 8 filter 13BX has a 
5 delay time, which will be described later, different from 
that of the improved e filter 13AX, and thereby has a 
sampling pitch for the smoothing processing different 
from that of the improved e filter 13AX. The other 
features of the improved e filter 13BX are the same as 
10 those of the improved e filter 13AX. 

The non-linear smoothing unit 2 has a prescribed 
number of stages of such improved e filters having a 
sampling pitch different from each other for the 

15 smoothing processing in a serial connection disposition. 
Thereby, the non- linear smoothing unit 2 performs the 
smoothing processing for each frequency component of the 
pixel value corresponding to each sampling pitch, and 
thereby the non- linear smoothing unit 2 performs the 

20 sufficient smoothing processing over a substantially wide 
frequency range with respect to the total frequency band. 

Improved 8 filters 13AY, 13BY,.. are have the 
configuration similar to those of the improved 8 filters 

25 13AX, 13BX, . . except the point that the improved e 

filters 13AY, 13BY, . . performs the smoothing processing 
in regard of the vertical direction. Accordingly, the 
improved e filter 13AY, which is the first stage of the 
improved e filter 13AY, 13BY, .., is configured so that 

30 the image data is changed in its arrangement by the use 
of a memory not shown in the figure and is input to the 
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improved e filter 13AY. By the aforesaid configuration, 
the non-linear smoothing unit 2 performs the smoothing 
processing of the input image in its horizontal direction 
and its vertical direction over a wide frequency band 
5 while preserving the edge thereof. 

A look-up table 14 performs the inverse logarithmic 
transformation of the image date that was smoothed by the 
improved e filters 13AY, 13BY, . . , conversely to the 
look-up table 12, and outputs the transformed data. A 
lowpass filter 15 is a linear lowpass filter like the 
lowpass filter 11, and slightly dulls the edge of the 
output image L3 output from the look-up table 14 that was 
smoothed while preserving the edge. Thereby, a part in 
vicinity of the edge of the output image Y is smoothed so 
that occurrence of unnatural feeling resulted by a series 
of the processing may be obstructed. 

(1-2-1) IMPROVED e FILTER 
20 Because the improved e filter 13AX is a filter that 

modified a part of the configuration of the general e 
filter, a configuration of the improved e filter 13AX 
will be described in contradistinction to an e filter in 
the following. Incidentally, because the configuration 
25 of the improved e filter 13BX, . . is the same as that of 
the improved e filter 13AX except that their sampling 
pitches for the smoothing processing differ from each 
other, parts concerning the different configuration are 
suitably described here and a duplicate description is 
30 omitted. Moreover, the configurations of the improved e 
filters 13AY, 13BY, are the same as those of the 
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improved e filters 13AX, 13BX, . . except that an order of 
the image data to be processed is different, the 
duplicate description is also omitted. 

5 An input -output characteristic of an ordinary one- 

dimensional e filter having 2N + 1 taps can be expressed 
by equation 1 shown in Fig. 1, where s n indicates an 
output value; r n indicates an input value; e indicates a 
prescribed reference value; r n indicates the input value 
10 of the center of an object to be processed; and a k 

indicates a weighting coefficient. Moreover, a range of 
summation (sigma) in the second formula in the equation 1 
is from k = -N to k = N. 

15 Thereby, when the output value s n of a pixel p n 

having a pixel value r n is computed, as shown in Fig. 9A, 
a weighting addition processing is performed as follows: 
that it, as to the pixel p n -k at which the absolute value 
of the difference between the central pixel value r n and 

20 the pixel value of the pixel p n _)c r n - r n _ k is larger 

than the reference value e among the pixels P1-P2N+1 being 
objects of the computation processing, the pixel value 
r n _ k is replaced with the central pixel value r n . 
Moreover, as to the pixel p n -k at which the absolute value 

25 of the difference of the pixel values r n - r n -k is equal 
to or less than the reference value 8, the pixel value r n _ 
k of the pixel p n _ k is used. 

That is, as shown in Fig. 9A, when the output value 
30 s n of a pixel P n is computed by the e filter, the value s n 
is computed by the replacement of the pixel value r m of a 
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pixel p m at which the pixel value r m differs from that of 
the pixel P n in an extent larger than the reference value 
e as the judgment reference among the before and the 
behind of the pixel P n with the pixel value r n . Thereby, 
5 as shown in Fig. 9B, the small variations of the pixel 
values are suppressed while the edge is preserved in 
comparison with the processing of a plain linear lowpass 
filter. 

However, in this method, because the pixel value is 

judged on the basis of the reference value 8 with the 
value r n of the pixel P n the output value of which is 
computed as the center, and then the output value s n is 
computed by the weighting addition by means of the 
replacement of the pixel value with the pixel value r n of 
the pixel P n . Accordingly, the small variations of the 
pixel value can be suppressed while the edge is preserved 
when the pixel value x varies at almost constant direct 
current level like both the sides of the edge shown in 
Fig. 9A. However, it becomes difficult to smooth the 
pixel value sufficiently when the direct current level 
varies as shown in Fig. 10. 

That is , when a direct current level of an input 
25 value r increases or decreases gradually, the more a 

pixel becomes distant from the pixel P n at which output 
value s n is computed, the less the number of the pixels 
included in a region set on the reference value e becomes . 
Moreover, in this case, even if the weighting addition by 
30 the replacement of the value r n of the pixel P n , the 
smoothing processing may not be performed on the 
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reflection of the variations of the direct current level 
correctly . 



Accordingly, in the present embodiment, as shown by 
5 the following equation in contradistinction to the 

equation 1 shown in Fig. 1, the variation of the direct 
current level is approximated by a certain function, and 
a region (2el) is set by means of the function around the 
pixel value r n of the pixel P n for the judgment of a 
10 pixel value. Moreover, as for a pixel out of the region, 
j% the pixel value is replaced with a pixel value on the 

f; function for performing the smoothing processing. 

fSSW 

01 Incidentally , here, a range of the sigma in the second 

j£ formula in equation 2 shown in Fig. 2 is k = -N to k = N, 

^ 15 and a range of the sigma of the second formula in 
O equation 3 is s - -M to s = M - 1 . 

ni 

z.i Here, the linear function is applied as the 

M aforesaid function, and the variations of the direct 

20 current level are processed by linear approximation. 
That is, an averaged value K a of the inclinations of 
straight lines connecting adjoining pixels among 2M 
pixels before and behind a pixel at which the output 
value s n is computed. And then, a region is set on the 

25 basis of the averaged value K a of the inclinations to 
judge a pixel value, and further pixel values are 
replaced to be situated on the straight line. Thereby, 
the present embodiment can perform the smoothing 
processing while preserving the edge with much better 

30 reliability in comparison with the prior art. 

Incidentally, a case where the average value K a of the 
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improved e filter is set to zero is the characteristic of 
a general e filter described with regard to Fig. 9. 

Fig. 11 is a block diagram showing the improved e 
5 filter 13AX. In the improved e filter 13AX, a pixel 
value r to be smoothed is input in turn into delay 
circuits (D) 21A-21F having a prescribed delay time, and 

the improved e filter in this example is configured to 
have seven taps. Now, the delay circuits 21A-21F are 

10 constituted of a prescribed number of stages (m stages) 

of registers 22A-22N connected in series as shown in Fig. 
12. Hereby, the improved e filter 13AX can select seven 
samples of the pixel value r(i, j) at the sampling pitch 
corresponding to the number of stages of the register 

15 train 22A-22N (namely, corresponding to the delay times 
of the delay circuits 21A-21F). 

The improved £ filter 13AX performs its processing 
by selecting pixel value r according to the sampling 

20 pitch corresponding to the number of stages of the 

registers 22A-22N, and thereby the improved e filter 13AX 
performs its smoothing processing by using a wide extent 
of pixel values to that degree before and behind the 
pixel the output value of which is to be computed. 

25 Thereby, the processing at the following stages is 
simplified correspondingly to the wide extent. 
Incidentally, if the smoothing processing is performed by 
the use of pixel values in such a wide extent , the 
variations of the pixel values owing to the low 

30 frequencies can be sufficiently suppressed to that degree. 
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Incidentally, the improved e filter 13BX, . . are 
configured to have registers the number of stages of 
which is different from that of the improved e filter 
13AX, and are configured so that the delay times of the 
corresponding delay circuits 21A-21F are different from 
those of the improved e filter 13AX. Thereby, the 
improved e filter 13BX, . . are configured to perform 
their smoothing processing in accordance with the 
frequency characteristics different from those of the 
improved e filter 13AX. 

To the inclination computing circuit 24 (shown in 
Fig. 11), a pixel value input into the first stage delay 
circuit 21A is input together with the output values from 
the delay circuits 21A-21F, and then seven sampled r(i, 
j) corresponding to the delay times of the delay circuits 
21A-21F are input. An inclination computing circuit 24 
executes a computation processing of equation 3 shown in 
Fig. 3 to compute the averaged value K a of the 
inclination for outputting it. 

Arithmetic operation circuits 25A-25F perform 
computation processing of the third formula and the 
fourth formula in the equation 2 shown in Fig. 2 with 
25 regard to the outputs of each tap r n _ 3ni , r n _ 2m , r n - m , r n+m , 
r n+2m , r n+3m among pixel values at the seven tap output 
from the delay circuits 21A-21F except the output value 
r n of the center tap, respectively, and output the 
processing results w n _ 3m , w n . 2m , w n _ m# w n+m , w n+2 m, w n+3m , 
30 respectively. Incidentally, here, m indicates the number 
of stages of the registers in the delay circuits 21A-21F. 

18 
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That is, in the arithmetic operation circuit 25A 
(25B-25F), as shown in Fig. 13, the averaged value K a of 
the inclination is input to a multiplier 28, and the 
5 multiplier 28 multiplies the input average value K a by 
the distance k from the center tap corresponding to each 
tap output r n -3m, r n -2m, r n . m , r n+m , r n+ 2m, r n+3m , severally, 
and thereby the deviation K a *k at the sampling point of 
each tap output r n _ 3m , r n -2m* r n - m , r n+ra , r n+ 2m/ r n+3m from the 
10 center tap output r n is computed in accordance with the 
linear function of the average value K a of the 
inclinations (see equations 2 and 3). 

J A subtracter 29 computes the v n -k in the equation 2 

m 15 by subtracting the output value K a *k of the multiplier 28 
Q from each tap r n _ 3m , r n -2nw r n _ m , r n+m , r n+2m , r n+3m to output 

m it: • 

Ft; 

A subtracter 30 computes the (r n - v n -k) in the 
20 equation 2 by subtracting the output value v n _ k of the 
subtracter 29 from the center tap output r n# and output 
the result. 

The absolute value circuit 31 computes the r n -v n - 
25 k in the equation 2 by taking the absolute value of the 
output value (r n - v n -k) of the subtracter 30, and outputs 
the results. 

A comparator (CMP) 32 performs a largeness judgment 
30 processing in the equation 2 by comparing the output 

value r n -v n -k of an absolute value circuit 31 with the 
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reference value el for the region setting mentioned above 
with regard to Fig. 10, and outputs the judgment result 
in term of a switching signal for a selector (SEL) 33. 



UJ 



5 An adder 34 computes the r n + K a *k in the equation 2 

by adding the center tap output r n and the output value 
K a *k of the multiplier 28, and outputs the results. 

The selector 33 selectively outputs each tap output 
10 r n -3m, r n - 2 m, r n . m , r n+ mr r n+2 nw r n+3m or the output value r n + 
K a *k of the adder 34 in accordance with the switching 
signals SEL output from the comparator 32. 

By the aforesaid configuration, the arithmetic 
15 operation circuit 25A adjusts a linear function of the 

inclination computed by the inclination computing circuit 
24 so as to pass the position of the pixel value r n of 
the pixel P n at which the output value is computed, and 
sets a region having a value el on the upper and" lower 
20 sides of the disposed straight line. Then, a pixel the 
pixel value of which protrudes from the region is judged 
to be the edge and the pixel value is replaced with a 
pixel value on the straight line, and as to a pixel in 
the region, the computing result based on the original 
25 pixel value of the pixel is output. 

Weighting circuits 36A-36G shown in Fig. 11 perform 
weighting processing of the output values from the 
arithmetic operation circuits 25A-25F or the output value 
30 from the center tap by the use of weighting coefficients 
corresponding to each tap and output the results. 
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respectively, and thereby executes the computation 
processing of each term of the sigma in the first formula 
in the equation 2. 



5 An adder 37 adds the output values from these 

weighting circuits 36A-36G, and thereby executes the 
computation processing of the first formula in the 
equation 2, and outputs the processing result. 

10 (1-2-2) LOOKUP TABLE 3 

t " Now, Fig. 14 is a characteristic curve diagram 

showing the gradation conversion characteristic of a low 
01 frequency component of the image processing circuit 1. 

The input -output characteristic of the lookup table 3 is 
w 15 set by the gradation conversion characteristic shown in 

Q Fig. 14. 



That is, when a pixel value s max that is the largest 
value in the low frequency component is input into the 

20 image processing circuit 1, the corresponding output 

value is set to s cm p in accordance with a characteristic 
curve designated by mark L2. In this case, the 
compression rate gl of the dynamic range is expressed by 
Scmp/Smax- As shown by the characteristic curve designated 

25 by the mark L2, in an extent up to the pixel value si of 
the low frequency component, output values generated from 
input values by a gain of one are output. Incidentally, 
the pixel value si is smaller than the upper limit of the 
dynamic range of the output image, and the pixel values 

30 having values equal to or smaller than the value si in 
the input image X are considered as not necessary to 
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compress the gradation of the pixel value . 

The look-up table 3 divides each value on the 
ordinate axis by the conversion characteristic curve 
5 having a gain one and being designated by the mark LI 
that is the conversion characteristic curve up to the 
pixel value si, and the input-output characteristic is 
set by the operation expressed by L2/L1. 

10 (2) OPERATION OF FIRST EMBODIMENT 

In the aforesaid configuration, in the image 
processing circuit 1 (Fig* 4), the input image X, which 
is an photographed result or the like, is input into the 
non-linear smoothing unit 2 (Fig. 5A and Fig. 5B) , and 

15 the input image X is processed to be smoothed while the 
edge thereof is preserved by the non- linear smoothing 
unit 2, and thereby the smoothed image S is generated. 
Because the smoothed image S is here processed to be 
smoothed while the edge thereof is preserved, the 

20 components that determine the contrast of the object and 
are desired to be preserved without being compressed and 
further are independent of the dynamic range of the image 
are removed, and only the components that determines the 
dynamic range of the image is separately taken out. 

25 

In the image processing circuit 1, by the access of 
the look-up table 3 by means of the smoothed image S, the 
gain correction coefficients g(i, j) are generated in 
sequence (Fig. 5C and Fig. 6), and the pixel value x(i, 
30 j) of the input image X input through the delay circuit 4 
is multiplied by the multiplier 5 to compress the dynamic 

22 
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range of the input image X (Fig. 5D) . At this time, the 
pixel value x(i, j) of the input image X is corrected by 
the gain correction coefficient g(i, j) of the smoothed 
image S being only the component to determine the dynamic 
5 range of the image, and consequently, only the variations 
of the pixel value as the whole are selectively 
compressed and generated while the localized variations 
of the pixel value and the edge of the image are 
preserved. Thereby, the image Z in which the 
10 deterioration of the contrast feeling that is a contrast 
to look at is evaded and the dynamic range thereof is 
03 fully compressed is generated. Moreover, as for the edge, 

gi the change of the frequency characteristic is also 

prevented, and thereby the unnatural emphasis of the edge 
yj 15 is prevented. 

5 

In the image processing circuit 1, by the access to 
yj the look-up table 6 by the pixel value of the image Z the 

yi dynamic range of which was thus compressed (Fig. 4 and 

20 Fig. 7), the gradations in the vicinity of black and 
white are selectively compressed, and thereby output 
image Y is output while evading effectively the situation 
in which the gradations in the vicinity of black and 
white are lost even if the input image X having an 
25 extremely large dynamic range is input. 



Accordingly, for example, an imaging apparatus such 
as a video camera and an electronic still camera using 
the image processing circuit 1 may enable to prevent 
30 deterioration in the quality of the imaged result by 
performing the recording and the reproducing of the 
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imaged results with its recording and reproducing system 
having a narrower dynamic range than that of the imaged 
result. Incidentally, in the imaging apparatus, such an 
imaged result wider in the dynamic range than an ordinal 
5 case may be obtained by the selection of the image pickup 
device, the synthesis of the image data with different 
sensitivity and so on. Moreover, when an image data 
having such a wider dynamic range is displayed by the 
application to an image displaying apparatus in 
10 accordance with the present embodiment, a high quality 
y image may be displayed. 

: 3 

Moreover, even if an image having a wide dynamic 
^zi range is variously processed by the application of the 

yj 15 image processing circuit 1 to the image correction such 

pi as the backlight correction, and the image synthesis and 

2t the image processing using a computer, the result of the 

jj processing can be transmitted, recorded and reproduced 

Zl without the deterioration of the quality of the image. 

20 Thereby, such various processing can also be performed in 
high quality. Moreover, when the image processing 
apparatus is applied to an image transmission apparatus, 
an image can be transmitted at a high speed with the 
effective evasion of the deterioration of image quality. 

25 

When the image processing circuit smoothing a pixel 
value while preserving the edge component, the non- linear 
smoothing unit 2 (shown in Fig. 8) of the image 
processing circuit 1 limits a band width of the pixel 
30 value x(i, j) of the input image X with the lowpass 

filter 11, and then performs the smoothing processing 
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while preserving the edge of the input image X with the 



improved e filters 13AX, 



and consequently the 



generation of noise in a shape of a point in an output 



image Y may be prevented. 



5 



Moreover, by setting a band limitation in the 
smoothed image S at the last stage low pass filter of the 
non-linear smoothing unit 2, the unnatural variations of 
a pixel value near to the edge may be lowered, and 
10 thereby there may be obtained an output image Y in which 
the vicinity of its edge is expressed smoothly. 

Moreover, after the logarithmic transformation of 
the pixel value x(i, j ) by the look-up table 12 and the 

15 execution of the smoothing processing while preserving 
the edge, the smoothed image S is generated by the 
inverse logarithmic transformation by the look-up table 
14, and thereby mutual differences between the smoothing 
processing results in the pixel values may be prevented, 

20 and the unnatural compression of the dynamic range of the 
output image Y may be prevented. 

Moreover, the filtering processing of the input 
image that suppresses the high frequency components 

25 thereof while preserving the edge thereof is successively 
performed by the improved e filters 13AX, 13BX, . . in the 
horizontal direction, and then the similar processing is 
performed by the successive improved e filters 13AY, 
13BY, .. in the vertical direction. Thereby, it becomes 

30 possible to generate the output image Y that secures a 
sufficient contrast feeling in the vertical direction. 
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the horizontal direction and further oblique directions, 
and prevents the unnaturalness of the edge. 

Moreover, the improved e filters 13AX, 13BX, . . , 
5 13AY, 13BY, . . perform the filtering processing, in which 
the edge is preserved in each direction, repeatedly at 
different sampling pitches, and thereby the image 
processing circuit 1 can generate the smoothed image S 
that is sufficiently smoothed in a wide frequency band 

10 while the edge information thereof is preserved. 

Consequently, the image processing circuit 1 can execute 
the smoothing processing so that only a specific 
frequency component is selectively left in such a 
smoothed image S, and the deterioration of the image 

15 quality of the output image Y can effectively be evaded 
in that degree . 

In each improved s filter 13AX, 13BX, . . , 13AY, 
13BY, (Fig. 10 and Fig. 11), the pixel value r is 

20 input in sequence into the delay circuits 21A-21F 

connected to each other in series , each tap output value 
other than the center tap output is judged by the 
arithmetic operation circuits 25A-25F severally on the 
basis of the center tap output among the seven tap 

25 outputs from the delay circuits 21A-21F (Fig. 13). 

Moreover, when a pixel value greatly differs from the 
center tap output, the pixel value is judged to cross 
over an edge, the pixel value different greatly is 
replaced with a prescribed value. Thus the weighting 

30 addition of the center tap output and the other tap 

outputs is performed by the weighting circuits 36A-36F 
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and the adder 37 whereby performing the smoothing 
processing. 

In the processing, because in each improved e 
filter 13AX, 13BX, . ., 13AY, 13BY, . ., each delay circuit 
21A-21F is configured by a serial circuit of the 
registers 22A-22N, the smoothing processing is executed 
by the sampling of the continuous pixel values at a pitch 
of the number of the registers connected in series. 
Accordingly, the smoothing processing can be executed by 
arranging the number of the arithmetic operation circuits 
25A-25F, the weighting circuits 36A-36F and the adder 37 
correspondingly to the tap outputs, and thereby the whole 
configuration thereof can be simplified in that degree. 
Moreover, as to the pixel value that is an object of the 
smoothing processing, the smoothing processing can be 
performed by the use of the pixel values in a wider 
extent in comparison with the configurations of the 
arithmetic operation circuits 25A-25F, the weighting 
circuits 36A-36F, and the adder 37, and thereby, for 
example, pulsing variations having a low frequency can 
sufficiently be smoothed. 

Because in the image processing circuit 1, each 
25 improved e filter 13AX, 13BX, .., 13AY, 13BY, is 

designed so that the number of stages of the resisters 
22A-22N constituting the delay circuits 21A-21F differs 
from each other, as mentioned above, the filtering 
processing is repeatedly executed at different sampling 
30 pitches, and consequently, the deterioration of the image 
quality of the output image Y can be prevented. 
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In such processing of replacing the pixel value by 
performing the edge judgment based on the center tap 
output, in each improved e filter 13AX, 13BX, . ., 13AY, 
5 13BY, .., the low frequency component of each tap output 
is approximated to a prescribed function, and a region 
(2el) is set by the function on the basis of the center 
tap output (Fig. 10), and then the edge is judged whether 
the pixel value belongs to the region or not. Thereby, 
10 each improved e filter 13AX, 13BX, .., 13AY, 13BY, . . can 
^ judge the edge similarly in a case where the pixel values 

05 have no increase or decrease inclination even if the 

pi pixel values have the gradual increase inclination or the 

'% gradual decrease inclination. Consequently, the 

US 15 deterioration of the output image Y owing to the 

p variation of such judgment can be prevented. 

UJ Moreover, in a case where a pixel value is replaced 

Cl by the judgment of that the pixel is at the edge part, 

20 the pixel value to be replaced is determined on the basis 
of the function obtained in such a way. Accordingly, the 
variations of the pixel value at such a low frequency are 
reflected to the weighting processing, and thus it 
becomes possible to make the output image having far high 
25 quality. 

Moreover, in the present embodiment, a series of 
processing can be executed by the simple configuration 
such that a straight line inclination is obtains by the 
30 application of the linear function as the function, and 

further that the processing of the judgment and so on are 
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executed by using the straight line inclination obtained. 

That is, in each improved e filter 13AX, 13BX, . ., 
13AY, 13BY, . . , the inclination computing circuit 24 
5 computes differential values between adjoining tap 

outputs among the seven tap outputs, and computes the 
averaged value K a of the inclination from the averaged 
value of the differential values. Moreover, in each 
arithmetic operation circuit 25A-25F, at the sampling 

10 positions of tap outputs other than the center tap, the 

differential value K a *k from the center tap output at the 
inclination is computed by the multiplier 28 on the basis 
of the averaged value K a of the inclination and the 
distance k from the center tap position. And then, the 

15 successive subtracters 29, 30 compute the differential 
value between the pixel value on the function of the 
inclination K a and the actual pixel value of the tap 
output, and the comparator 32 judges whether the 
differential value is larger than the reference value el 

20 or not. The judgment processing to judge whether or not 
the pixel is an edge by using an approximate function 
comprising the linear function is consequently executed. 

Furthermore, on the other hand, the adder 34 
2 5 computes the pixel value on the function of the 

inclination K a , and any one of the actual tap output and 
the pixel value on the function that was thus computed is 
selected to be output according to the judgment result by 
the comparator 32. Consequently, the pixel value of the 
30 pixel crossing the edge is replaced with the pixel value 
computed by using the approximate function comprising the 
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linear function, and then each tap output is output to 
the corresponding weighting circuit . 

Accordingly, as to the input image X having various 
image qualities in wide dynamic ranges, the image 
processing circuit 1 can compress the dynamic range 
sufficiently while preventing the deterioration of the 
edge and the lowering of the contrast sense. 

(3) EFFECT OF FIRST EMBODIMENT 

According to the aforesaid embodiment, the input 
image X is smoothed while the edge thereof is preserved, 
and the gain correction coefficient g is obtained to 
correct the pixel value of the input image by means of 
the obtained gain correction coefficient g. Consequently, 
the dynamic range of the image can be compressed at a 
higher compression rate while the lowering of an 
impression concerning the contrast and the unnatural edge 
emphasis of the input image are effectively evaded. 

Moreover, after the dynamic range was thus 
compressed, further the gradation is corrected by the 
look-up table 6, and thereby the loss of the gradation in 
the vicinity of black and in the vicinity of white can 
effectively be evaded. 

Moreover, when the input image X is thus smoothed 
while the edge thereof is preserved, after the band 
limitation with the lowpass filter, the processing of the 
logarithmic transformation is performed. Moreover, the 
inverse logarithmic transformation of the result of the 
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logarithmic transformation processing is performed, and 
thereby the generation of noise in a shape of a point is 
prevented, and further the mutual differences between the 
smoothing processing results in pixel values can be 
5 prevented. 

Moreover, when the input image X is smoothed while 
the edge thereof is preserved, a plurality of filtering 
processing with the sampling pitches which are different 
10 from each others are repeated, and then an uniform 

smoothing processing in the wide frequency band can be 
performed. Accordingly, the output image Y having high 
quality can be output . 

15 Moreover, by performing the smoothing processing by 

the sampling of a continuing pixels at a prescribed pitch, 
the smoothing processing of a wide extent pixel values 
can be executed with a simple configuration, and thereby 
the smoothing processing for a low frequency is also 

20 fully performed to make it possible to obtain a high 
quality output image Y. 

Moreover, by the approximation of a function in 
accordance with the pixel values to set a region on the 
25 basis of the function for the judgment of the edge in the 
smoothing processing, and further by the computation of 
the pixel value to be replaced by means of the function, 
a high quality output image Y can be obtained. 

30 Furthermore, by using a linear function for the 

function, the configuration as a whole may be simplified. 
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(4) SECOND EMBODIMENT 

Fig. 15 is a block diagram showing an image 
processing circuit according to a second embodiment of 
5 the present invention in comparison with the first 
embodiment shown in Fig. 4. In the image processing 
circuit 41, the identical constitutional components to 
those of the image processing circuit 1 are designated by 
corresponding marks, and the overlapping description of 
10 them is omitted. 

The image processing circuit 41, like the image 
processing circuit 1, as shown in Figs. 16A-16F, smoothes 
the input image X (Fig. 16A) constituted of the pixel 

15 value x(i, 3) to generate a smoothed image S (Fig. 16B) , 
and compress the dynamic range of the input image X by 
the gain correction coefficient g(i, 3) (Fig. 16C) 
generated by the pixel value s(i, 3) of the smoothed 
image S. In the processing, the image processing circuit 

20 41 emphasizes the variations of the pixel value y(i, 3) 

of the output image Y by using the subtraction value x(i, 
3) - s(i, 3) which is obtained by subtracting the output 
value s(i, 3) in the smoothing processing from the pixel 
value x(i, 3) of the input image X. 

25 

That is, in the image processing circuit 41, the 
subtracter 42, the multiplier 43, the adder 44 are 
arranged in order between the delay circuit 4 and the 
multiplier 5. Here, the subtracter 42 subtracts the 
30 output value s(i, 3) by the smoothing processing from the 
pixel value x(i, 3) of the input image X to output the 
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subtracted value x(i, j) - s(i, 3) (Fig. 16D). The next 
multiplier 43 amplifies the subtracted value x(i, 3) - 
s(i, 3) by a prescribed gain K (Fig. 16E), and the adder 
44 adds the pixel value s(i, 3) of the smoothed image S 
5 to the output value of the multiplier 43. Thus, the 

image processing circuit 41 multiplies the result of the 
addition of the adder 44, that emphasizes small pulsing 
variations to be eliminated by the non- linear smoothing 
unit 2 in comparison with the input image X, with the 
10 multiplier 5 to generate the output image Y. 

Consequently, the image processing circuit 41 is 

o 

rjj* configured so as to output the so-called sharper image in 

comparison with the image processing circuit 1 described 

C=£C3 

01 above with regard to Fig. 4 to the extent that such small 

O 

j* 15 pulsing variations are emphasized. 

Q According to the configuration shown in Fig. 15, by 

ry the emphasis of the variations of the pixel values y(i, 

Zi 3) by the use of the subtracted value x(i, 3) - s(i, 3) 

h- 20 obtained by the subtraction of the output value s(i, 3) 

in the smoothing processing from the pixel value x(i, 3) 
of the input image X, further sharper image can be output 
in addition to the effects of the first embodiment. 



25 (5) THIRD EMBODIMENT 

Fig. 17 is a block diagram showing an image 
processing circuit 51 in accordance with a third 
embodiment of the present invention in comparison with 
the embodiment shown in Fig. 15. In the image processing 

30 circuit 51, the identical constitutional components to 
those of the image processing circuit 41 are designated 
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by reference marks corresponding to those of the image 
processing circuit 41, and the overlapping description is 
omitted. 

5 The image processing circuit 51 sets the gain of 

the multiplier 43 by accessing a look-up table 52 by the 
output value s(i, j) of the smoothed image S. Here, the 
input-output characteristic of the look-up table 52 is 
set as shown in Fig. 18. Hereby, the look-up table 52 
10 sets the gain of the multiplier 43 at a constant gain 
when the output value s(i, j) is equal to a prescribed 

~a value or less, and sets the gain so as to approach 

gradually to the value one when the output value s(i, j) 

01 increases to be equal to the prescribed value or more. 

£ 15 

Thereby, the image processing circuit 51 is 
w configured so as to decrease the extent of the emphasis 

m of contrast in a region where the pixel value has a large 

value. That is, there are many cases where the contrast 
h' h 20 is also sufficiently large at the vicinity of a pixel 

having a large pixel value in general images . 
Accordingly, if the contrast is uniformly emphasized, the 
contrast is emphasized more than the extent to be needed 
in the vicinity of such a pixel, and the output image is 
25 observed to be inferior in its quality by that extent in 
the results of the processing. However, if the degree of 
the emphasis of the contrast in the region where the 
pixel values are large is decreased like the present 
embodiment , the image with natural high quality can be 
30 output as a whole. 
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According to the configuration shown in Fig. 17, by 
varying the degree of emphasizing in accordance with the 
pixel value, the image with the far higher quality can be 
output . 

5 

(6) FOURTH EMBODIMENT 

Fig. 19 is a block diagram showing an image 
processing circuit according to a fourth embodiment of 
the present invention in comparison with the embodiment 
10 shown in Fig. 15. 



The image processing circuit 61, as shown in Fig. 
£2 19, eliminates noises of the input image X in advance 

Jf* with a noise elimination filter 62, and then enlarges the 

42 15 dynamic range of the input image X by the multiplication 

^ of a uniform gain with the successive multiplier 63 (Fig. 

^ 20A and Fig. 20B) . After the multiplication processing, 

fl! the image processing circuit 61 compresses the dynamic 

%l range with the image processing circuit 1 to the original 

20 dynamic range of the input image X, and output the 
processing results (Fig. 20C). 

Here, as for the noise elimination filter 62, 
general coring processing, a median filter, an e filter 

25 or an improved e filter is applied. Moreover, in the 
present embodiment, the image processing circuit 1 
corrects a pixel value at a fixed gain to the pixels 
having a pixel value larger than a prescribed pixel value, 
and corrects a pixel value so that the gain increases to 

30 the pixels having a pixel value equal to the prescribed 
pixel value or less contrary to the characteristic 
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mentioned above about Fig. 6. 



According to the configuration shown in Fig. 19, 
the processing such as the correction of gradation can be 
5 executed with evading the deterioration of the image 
quality effectively of the image having extremely high 
contrasts such as back-lighted image. 

That is, in the image processing circuits mentioned 

10 above by reference to Fig. 4 and so forth, by the 

correction of the pixel value in accordance with the 
characteristic of monotonous decrease as shown in Fig. 6, 
the dynamic range of an input image X is compressed by 
lowering the brightness in only the light part of the 

15 input image X without lowering the brightness in the dark 
part of the input image X. However, by the present 
embodiment, the whole contrast can be compressed by 
raising the brightness only in the dark part of the input 
image X while the brightness of the part having the 

20 moderate light of the input image X is compressed not to 
become brighter than the present brightness by 
compressing the dynamic range of the input image X in 
accordance with the characteristic contrary to the 
characteristic shown in Fig. 6. The processing such as 

25 the back- lighted correction can be thereby accomplished. 

(7) FIFTH EMBODIMENT 

Fig. 21 is a block diagram showing an image 
processing circuit 71 in accordance with a fifth 
30 embodiment of the present invention. In the image 

processing circuit 71, the matrix circuit 72 performs the 
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computation processing of color signals R, G and B of red, 
blue and green, respectively, to generate a luminance 
signal Y and color difference signals R-Y, B-Y. 

5 The image processing circuit 1 compresses the 

dynamic range of the luminance signal Y by processing the 
luminance signal Y selectively and outputs the processing 
results. By compressing only the luminance signal Y 
selectively by the image processing circuit 1, the image 
10 processing circuit 71 prevents the change of the ratios 
of signal levels among the color signals R, B and G of 
red, blue and green, and thereby prevents the change of 
hue owing to the change of the ratios. 

15 The dividers 73 and 74 normalize the color 

difference signals R-Y, B-Y by the luminance signal Y by 
dividing the color difference signals R-Y, B-Y by the 
luminance signal Y severally. The delay circuits 77 and 
78 delay the color difference signals R-Y, B-Y output 

20 from the dividers 73 and 74 for an amount of the 

processing time with the image processing circuit 1 to 
output them. The multipliers 7 7 and 78 correct the pixel 
value of the color difference signal normalized with the 
dividers 73 and 74 by multiplying the luminance signal Y 

25 output from the image processing circuit 1 by the color 
difference signals R-Y, B-Y output from the delay 
circuits 77 and 78, respectively. 

That is, even if only the dynamic range of the 
30 luminance signal is compressed, because the color 

difference signals are difference signals between the 
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luminance signal and a color signal, the ratio of the 
component of saturation is raised at the corresponding 
luminance level when no correction of the signal level of 
the color difference signals is performed. In the end, 
5 the saturation becomes high when the image is seen as a 
whole . 

Accordingly, the image processing circuit in 
accordance with the present embodiment normalizes the 
10 color difference signal components with the luminance 

signal component in advance to compress the dynamic range 
of the luminance signal component. After that, the image 
^ processing circuit in accordance with the present 

embodiment corrects the pixel value of the color 
15 difference signal components normalized by the pixel 

value of the luminance signal component. Thereby, the 
embodiment preferably compresses the dynamic range of the 
color image signals by preventing the change in a color 
saturation. 

20 

(8) OTHER EMBODIMENTS 

Incidentally, in the aforesaid embodiments, a case 
where an edge is judged by the approximation comprising a 
linear function and a pixel value is replaced in the 
25 improved e filter is described. However, the present 
invention is not limited to such a case only. For 
example, by the approximation of a quadratic function or 
the like, these processing may be performed. 

30 Moreover, in the aforesaid embodiments, a case 

where an edge is judged by the approximation by means of 
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a function and the pixel value is replaced in the 

improved e filter is described. However, the present 
invention is not limited to the case. The approximation 
by a function may be used only for the judgment of an 
5 edge or only for the replacement of a pixel value. 

Moreover, in the aforesaid embodiments, a case 
where continuing pixel values are sampled at a prescribed 
sampling pitch to process them in the improved e filter 
10 is described. However, the present invention is not 

limited the case. All the continuing pixels may be used 
to process if a circuit with a sufficient capability is 
available in practice or the like. 

15 Moreover, in the aforesaid embodiments, a case 

where the input image is smoothed by repetition of the 
smoothing processing of the improved e filter is 
described. However, the present invention is not limited 
to the case. The repetition processing may be omitted if 

20 practically sufficient characteristic can be obtained in 
other way. 

Moreover, in the aforesaid embodiments, a case 
where the non-linear smoothing unit is configured by the 
25 improved e filter is described. However, the present 

invention is not limited to the case. Alternatively, the 
non-linear smoothing unit may be configured using a usual 
e filter. 

30 Moreover, in the aforesaid embodiments, a case 

where the input -output characteristic is finally 
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corrected with the look-up table 6 is described. However, 
the present invention is not limited to the case. The 
processing using the look-up table 6 may be omitted, or 
the look-up table 3 may also be used for correcting the 
characteristic . 

Moreover, in the aforesaid embodiments, a case 
where the image processing circuit is configured so as to 
process pixel values at each circuit block is described. 
However, the present invention is not limited to the case. 
The whole or a part of the circuits may be used to 
process with the computation processing. 

According to the present invention, a gain 
correction coefficient is obtained by smoothing an input 
image while preserving the edge of the input image, and 
corrects the pixel number of an input image by means of 
the obtained gain correction coefficient, and thereby the 
present invention effectively avoids the lowering of an 
impression concerning the contrast and the unnatural edge 
emphasis of the input image and makes it possible to 
compress the dynamic range of the input image in a higher 
compression rate. 

Although the invention has been described in its 
preferred form with a certain degree of particularity, 
obviously many changes and variations are possible 
therein. It is therefore to be understood that the 
present invention may be practiced than as specifically 
described herein without departing from scope and the 
sprit thereof . 
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